Information transfer through disordered media by diffuse waves 
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We consider the information content h of a scalar multiple-scattered, diffuse wave field ip(r) and 
the information capacity C of a communication channel that employs diffuse waves to transfer the 
information through a disordered medium. Both h and C are shown to be directly related to the 
mesoscopic correlations between the values of ip(r) at different positions r in space, arising due 
to the coherent nature of the wave. For the particular case of a communication channel between 
two identical linear arrays of n > 1 equally-spaced transmitters/receivers (receiver spacing a), we 
show that the average capacity (C) oc n and obtain explicit analytic expressions for (C) jn in the 
limit of n —* oo and k£ — > oo, where k — 2n/X, A is the wavelength, and £ is the mean free path. 
Modification of the above results in the case of finite but large n and kl is discussed as well, ff the 
signal to noise ratio S/N exceeds some critical value (S/N) c , (C) /n is a non-monotonic function of 
a, exhibiting maxima at ka = mn (m = 1,2,...). For smaller S/N, ka = run correspond to local 
minima, while the absolute maximum of (C) jn is reached at some ka ~ (S/N) 1/2 < it. We define 
the maximum average information capacity (C) max as (C) maximized over the receiver spacing a 
and the optimal normalized receiver spacing (fca) opt as the spacing maximizing (C). Both (C) max jn 
and (te)o P t scale as {S/N) 1/2 for S/N < (S/N) c , while (jfea) op t = mit and (C) max /n ~ log (S/N) 
for S/N > (S/N) c . 



I. INTRODUCTION 



Transport of coherent waves in disordered media have 
been extensively studied during the last decades jj], ||, 
H' [§ H' [1- Remarkably similar, diffusion behavior of 
multiple-scattered electronic wave functions at low tem- 
peratures I], [|, coherent electromagnetic Q (opti- 
cal H and microwave J5J ) , acoustic || , and elastic H 
waves has permitted impressive advances of the field M. 
Recently, multiple-scattered seismic waves in the Earth 
crust have been demonstrated to behave in a similar way 
]To| , O ], In the context of these studies, the main quanti- 
ties of interest are the transport coefficients of disordered 
samples, such as, e.g., the transmission coefficient T or 
the conductance g. The average values, fluctuations, full 
probability distributions, angular, spatial, and temporal 
correlation functions of T and g have been studied both 
theoretically and experimentally (see, e.g., Ref. ^ for a re- 
view). These quantities are, without any doubt, very im- 
portant, since they describe the transport of wave energy 
through a disordered sample and hence can be measured 
experimentally. On the other hand, in practical applica- 
tions one rarely uses multiple-scattered waves with a pri- 
mary purpose of energy transmission. Much more often, 
waves are used to transfer the information. Readily avail- 
able examples are microwave communications (portable 
telephony) in cities, indoor wireless local-area networks in 
building with complex structure, and underwater acous- 
tic communication systems. In fact, one of the main 
motivations to study the multiple scattering of waves in 
disordered media is their possible use for transmission or 
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processing of information in electronic devices or wireless 
communications. 

In the same way as the properties of a disordered sam- 
ple with respect to transmission of energy are described 
by the transmission coefficient T or conductance g (de- 
pending on the details of the specific experiment), its 
properties with respect to transmission of information are 
characterized by the information capacity C . The latter 
gives the maximum rate of error-free information transfer 
through a disordered sample using a given type of waves 
(acoustic, electromagnetic, etc.) and a given transmit- 
ter/receiver configuration (see Refs. |l2[ [l3[ [l4| for a more 
rigorous definition of C). Information capacity of com- 
munication channels in disordered media has recently re- 
ceived considerable attention gj], |B[ [y| |l|, ||, |l). 
The most interesting and important result concerns a 
communication system consisting of multiple transmit- 
ters and receivers JTHJ, |l6|, [l7], |l9|, |l|: it has been 
found that the capacity of such a communication system 
scales linearly with the number of receivers n (as long 
as the number of transmitters m is of the same order). 
The authors of Refs. 0, |§, |o[ |l] have also studied 
the effect of correlations between the signals received by 
different receivers on C . More specifically, the commu- 
nication channel between m transmitters and n receivers 
is described by a n x to Green matrix G (G a i is the sig- 
nal at the receiver a due to a unit signal emitted by the 
transmitter i). Due to the multiple scattering of waves, 
in a disordered medium the entries of G are random vari- 
ables with certain correlations between them. These cor- 
relations are often termed "mesoscopic" [|| because they 
originate from the fact that the phase coherence length of 
the considered wave exceeds the length of the path that 
the wave travels inside the disordered medium. Meso- 
scopic correlations complicate significantly the theoreti- 



cal calculation of capacity which otherwise (i.e., for un- 
correlated G ai ) is relatively straightforward [ll], po| . 
Although it follows from Refs. [l6| and 20 that nonzero 
correlations between G a i reduce the information capac- 
ity of the communication channel under particular con- 
ditions considered in that papers, no systematic study of 
the role of mesoscopic correlations in the context of infor- 
mation transfer is available at the time of writing. Meso- 
scopic correlations have been extensively studied during 
the last decade (see, e.g., Refs. |[ [|, and references 
therein) , but their role in the context of the information 
transfer has been completely ignored until very recently 
p6|, 19, |20|]. Meanwhile, understanding the relation be- 
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tween mesoscopic correlations and information capacity 
has not only the practical importance but also a fun- 
damental significance, since the correlations are usually 
affected by the symmetries of the problem (translational 
symmetry, time-reversal symmetry, etc.) and it might 
be interesting to study the influence of these symmetries 
on the information-theoretic quantities, such as the in- 
formation capacity. 

The purpose of the present paper is to consider the 
multiple-scattered wave field from the point of view of 
the information theory, to quantify its information con- 
tent, and, finally, to provide a comprehensive study of 
the information capacity of a communication channel in 
a disordered medium with a proper account for meso- 
scopic correlations arising from the coherent nature of 
multiple-scattered waves that carry the information. To 
be specific, we limit our consideration to identical lin- 
ear arrays of n equally-spaced transmitters/receivers (see 
Fig. Q). Such a geometry is common for microwave 
|jj and acoustic || experiments with multiple-scattered 
waves in disordered media Besides, it is also widely 
considered in connection with the time reversed acoustics 
p2fl and the BLAST architecture for efficient communi- 
cation over fading wireless channels j2^]. We note that 
the time-reversal techniques seems to be very promising 
for wireless communications in disordered and/or chaotic 
environments p4|] . 

The paper is organized as follows. We start by a study 
of the information content of the multiple-scattered wave 
field in Sec. |n]. The information content of a random 
field is quantified by its differential entropy. We show 
that mesoscopic correlations reduce the differential en- 
tropy reducing the information content of the multiple- 
scattered wave field and leading, in practice, to a smaller 
volume of computer memory required for its storage. Af- 
ter this somewhat introductory part of the paper, in Sec. 
HI we study the information capacity C of a communi- 
cation channel between two identical linear arrays of n 
transmitters/receivers in a disordered medium (see Fig. 
[[]). Under certain approximations, we obtain analytic ex- 
pressions for the average information capacity (C). The 
latter expressions provide a reasonable estimate of (C) in 
real experimental situations, although one can do better 
using numerical methods. Next, we show that mesoscopic 
correlations reduce the information capacity (as found in 
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FIG. 1: We consider the transfer of information between iden- 
tical arrays of n transmitters/receivers placed in a disordered 
medium. We denote the transmitter/receiver spacing by a 
and the distance between the arrays by L. A wave emitted 
by some transmitter i experiences multiple scattering in the 
disordered medium before reaching the receiver a. The sig- 
nal measured by the receiver a due to the transmitter i is 
given by the Green function G a i- The Green functions G a i 
(a, i = 1, . . . , n) form a Green matrix G. 



Rcf. |lGp only if the signal power is strong enough. If the 
signal is weak, correlations play a positive role and allow 
a higher capacity as compared to that in the absence of 
correlations. Finally, we define the maximum capacity as 
a capacity maximized over the transmitter/receiver spac- 
ing and the optimal transmitter/receiver spacing as the 
spacing maximizing the capacity. Simple analytic expres- 
sions are found for these two quantities. We summarize 
the main results of the paper in Sec. IV. Derivations 



of some important equations used in the main text but 
not essential for its understanding are provided in the 
Appendices |X] and [b|. 



II. INFORMATION CONTENT OF THE 
MULTIPLE-SCATTERED WAVE FIELD 

We start our analysis by considering a problem which 
is somewhat simpler than the one depicted in Fig. [I]. 
Namely, we assume that there is only one transmitter 
(located, say, at ro) that emits a monochromatic scalar 
spherical wave, and analyze the information content of 
the multiple-scattered wave field ip(r). As a consequence 
of multiple scattering, tp{ r ) is a random function of po- 
sition r ("speckle pattern"). Since ?/>(r) is a complex 
continuous random field, it contains an infinite amount 
of information or, in other words, an infinite volume of 
computer memory would be required to store its values at 
all r with absolute accuracy. In reality, however, one usu- 
ally measures at some finite number n of positions 
r a (a — 1, . . . , n). In the following, we identify the infor- 
mation content of such a measurement with the informa- 
tion content of keeping in mind that this is strictly 
true only for n — > 00. A measurement of in n points 
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FIG. 2: (a) The diagram contributing to the average inten- 
sity (I(r a )) for a point source of radiation at ro. The shaded 
rectangle is the ladder propagator, the solid lines denote the 
retarded and advanced average Green functions, (b) The 
diagram for the correlation function of the Green functions 



r a results in a random complex vector y = {y a }, where 

1/2 

Va = ip(r a )/ (I) and we normalize the field -0(r) by 



the square root of the average intenisty (I) — (^\ip(r a )\ 

given by the diagram (a) of Fig. || and assumed to be 
the same for all n receivers. From here on the angu- 
lar brackets denote averaging over disorder. If p(y) is a 
probability density function of the random vector y, the 
differential entropy of y is defined as Jl^ , |l3| 



p(y) logp(y)d n y. 



(1) 



The logarithm is to base 2 and h is hence measured in 
bits. The differential entropy h is a measure of uncer- 
tainty of the random vector y and reflects the average 
amount of information that one receives when some value 
of y is observed. The larger the differential entropy, the 
larger the information content of the vector y, and we 
will therefore use h to quantify the information content 
of y and, consequently, of the multiple-scattered wave 
field ip( r )- 

Under conditions of strong multiple scattering and pro- 
vided that | r Q — ro | ^> £ for all a = 1 , . . . , n and that 
k£ ^> 1 (where k — 2ir/\, A is the wavelength, and I 
is the mean free path), the wave field ip(r) can be con- 
sidered Gaussian to a good accuracy, and hence y is a 
circularly symmetric complex Gaussian random vector 
described by a Gaussian probability density function 



p(y) = det(vr^)- 1 exp (-y+K^y) 



(2) 



The 



where K is a covariance matrix: K a p = {t) a yp 

integration in Eq. (|l]) can be then carried out analytically 
yielding 



It also can be shown [R| that the Gaussian density func- 
tion (^|) maximizes the differential entropy for a given 
covariance matrix K. Recalling that K a p is the correla- 
tion function of the multiple-scattered wave field, we can 
readily compute K in the ladder approximation [see the 
diagram (b) of Fig. ^ with = r j = ro or Ref. |25| : 



sm(fcAr Q/3 ) 

K a/ 3 = — r-r exp 

kAr a p 
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(4) 



where Ar a p = \r a — rp\. We now restrict ourselves 
to the case of measurement points r Q arranged in a 
line with a constant distance a between r a and r Q+1 . 
As we already mentioned in Sec. |, such a measure- 
ment geometry is common for both microwave [Q and 
acoustic [2^] experiments. The covariance matrix 
K is then Tocplitz: K a p = K a ^p, where K 7 — 
sm['yka\/['yka\exTp[— \"f \ ka/ (2£)], and hence in the limit 
n — > 00 the density of its eigenvalues tends to a limit, 
which is the spectrum of y. The differential entropy rate 
can be then expressed through the power spectral density 
ofyM 



(5) 



The resulting h(y) appears to scale linearly with n and 
hence it is convenient to consider the differential entropy 
rate or the differential entropy per receiver 



f(fi)dfi. (6) 



U{y) = Urn = log^g) + _L / i og 

Equation (Q) allows us to compute f(p) explicitly: 

fU) = 1 + — (arctan sin(fcq + p) 

ka \ exp [ka/(2k£)] — cos(A:a + p) 



arctan 



sin(fca — /i) 



exp [ka/{2kl)\ — cos(fca — /i) 



This expression simplifies greatly in the limit kl 



00: 



ka 



1) 



(8) 



h(y) — logdet(7re-K"). 



(3) 



where m± denotes the greatest integer not larger than 
(ka± fi)/(2ir). We show the differential entropy rate fol- 
lowing from Eqs. (|^-||) in Fig. || by solid lines for k£ = 10, 
100, and k£ — > 00. In order to demonstrate the con- 
vergence of the exact formula (||) to the asymptotic Eq. 
(^), we also show the curves following from Eq. (||) for 
n = 50 (dashed lines) and the same values of kl. It is 
worthwhile to note that the entropy rate Ti reaches its 
maximum value log(7re) at ka ~ run (where m is a pos- 
itive integer) and that for ka > ir the variations of Ti 
with ka are extremely weak. Exact analytic result for 
Ti can be obtained in the limit kl — > 00 by substitut- 
ing f{n) given by Eq. (|sj) into Eq. (^|) and performing 
the integration. We find Ti — > —00 for ka < tt and 
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FIG. 3: Differential entropy rate TL as a function of normal- 
ized receiver spacing for the multiple-scattered wave field mea- 
sured by a linear array of n — > oo (solid lines) and n = 50 
(dashed lines) receivers at k£ — 10, 100, and k£ — > oo. 



TL = ka/n + log[(7re/2)(7r/fca)] for n < ka < 2n. At 
ka > 2tt, TL shows only weak deviations from its maxi- 
mum value log(7re). 

Let us now discuss the implication of Fig. |^ for experi- 
mental measurements. In an experiment, the values of y a 
cannot be measured with an absolute accuracy. A m-bit 
quantization of Hey a and Imy Q with a quantization step 
A ~ 2 _m is a common procedure (2^] and the measured 
quantized y' a can take ~ A~ 2 discrete values. The vec- 
tor y ' = {y^} can therefore take ~ A~ 2n different values. 
One can show that the entropy H(y r ) of y' is approxi- 
mately h(y) — 2n log A for A — ► 0. The number of bits 
required on average to describe a given component y' a of 
the random vector y ' is then H(y')/n ~ H(y) — 2 log A. 
It can be now easily seen that the smaller differential en- 
tropy rate Tl(y) means that less bits will be required in an 
experiment to record all the relevant information about 
the multiple-scattered wave field. As follows from Fig. 

at large receiver spacing a (ka > n), H is very close 
to its maximum value. At such a large receiver spac- 
ing, the signals measured by different receivers are only 
weakly correlated and hence each signal contains a rela- 
tively large amount of information. One therefore needs 
a relatively large number of bits per receiver H(y')/n 
to record the speckle pattern ijj(r) in this case. In con- 
trast, at small a (ka < n), TL decreases, since the sig- 
nals measured by different receivers become significantly 
correlated and hence the information contained in each 
of the signals on average, H(y')/n, is smaller than at 
ka > ir. If ki or n is finite, the value of TL at ka < ir can 
be small but remains finite. If, in contrast, we take the 
limit of k£ — > oo and n — > oo, TL — > — oo at ka < ir. This 
means that an infinitely small amount of information is 
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contained in the signal measured by a given receiver and 
is a direct consequence of the fact that in the absence of 
exponential damping of correlation in Eq. (^), the corre- 
lation range is infinite and the decrease of h(y) with n is 
faster than linear. 



III. INFORMATION CAPACITY OF A 
COMMUNICATION CHANNEL IN A 
DISORDERED MEDIUM 

A. General definitions 

After having considered the information content of the 
multiple-scattered wave field, we are now in a position 
to analyze the central problem of the present paper. We 
consider a communication channel between two identical 
linear arrays of n equally-spaced transmitters/receivers 
shown in Fig. [lj The vector of emitted signals x and the 
vector of received signals y are related by y = Gx + z, 
where G is a n x n complex Green matrix (G a i gives 
the signal measured at the receiver a due to a unit signal 
emitted by the transmitter i), and z is a noise vector. Wc 
consider scalar waves and assume that the noises z a at 
different receivers are statistically independent, normally 

distributed random variables with power N: l^z a z*^j — 

N8 a p. Before defining the information capacity of such 
a communication channel, we first remind the definitions 
of the conditional differential entropy p3| 



h(y|x) =- J J p(x,y) logp(y|x)d"xd"y, 



(9) 



and mutual information between two random vectors x 
andy@: 



J(x,y)=/ l (y)-ft(y|x), 



(10) 



where p(x, y) and p(y|x) are the joint and conditional 
probability density functions of x and y, respectively. In 
our case, y = Gx + z, and one finds h(y\x) — h(z) and 



y) = log det 



1 

N 



G+QG 



(11) 



Here /„ is the nx n unit matrix and we assume that x is 
a circularly symmetric complex Gaussian random vector 
with a covariance matrix Q: Qij — E \_XiX*\ , where E[. . .] 
denotes the averaging over all possible emitted signals 
x and should be contrasted from the disorder averaging 
that we denote by the angular brackets. 

If we assume that the Green matrix G is known at 
both transmitters and receivers, the Shannon informa- 
tion capacity C (or simply capacity for brevity) of the 
communication channel is found by maximizing the mu- 
tual information ( pX| ) over all possible distributions p(x) 
of emitted signals x. The fundamental importance of 
G is that it gives the largest information transfer rate 
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R that can be realized for a given information chan- 
nel in principle with infinitely small probability of error 
|l2| , Although no general procedure exists to real- 
ize R = C in practice, in many real situations one can 
achieve information transfer rates that are quite close to 
C fjof . Since the Gaussian distribution maximizes the 
differential entropy h (and hence the mutual information 
I) at a given Q (see Sec. [n] and Ref. [l3]), maximizing 
Eq. ( |l0| ) over p(x) amounts to maximize Eq. ( p"l| ) over 
Q. In practice, however, G is often known only at the 
receivers, but not at the transmitters, where only statis- 
tical information about G is available. In this case the 
optimal matrix Q is that maximizing the average mu- 
tual information (X(x, y)). To accomplish the averag- 
ing, we need to specify the statistical properties of the 
Green matrix G. In the considered case of strong multi- 
ple scattering, provided that the distance L between the 
arrays of transmitters and receivers is much larger than 
the mean free path I and that ki ^> 1, G a i is a circularly 
symmetric complex Gaussian random variable with zero 
mean and covariance given by the diagram (b) of Fig. |^: 

G a iG*g-\ — (I) K a pKij, where K a p is defined in Eq. 



(^) and (I) = (\G a i\ J is assumed to be independent 

of a and i. In the following we adopt the total emitted 
power constraint TrQ < n and introduce a normalized 
Green matrix Q — G / ((I) n) 1 / 2 . In the present paper 
we will only be interested in the average capacity (C), 
although it should be kept in mind that C exhibits ran- 
dom fluctuations as disorder is varied. As follows from 
the above reasoning, the average capacity is 



(C) = max ( logdet 



S_ 

N 



Q + QQ 



(12) 



where S/N plays the role of the signal to noise ratio 
and S = n (I) is the average power received by each re- 
ceiver assuming independent signals from transmitters. 
When Eq. (|l2| ) is applied to a real situation, it gives the 
maximum amount of information that can be transferred 
through the considered communication channel per sec- 
ond using a unit frequency bandwidth 12, f3|. The units 



of (C) are therefore bits per second per Hertz (or bps/Hz 
for brevity). 



B. Average capacity at n > 1 

For a small number of transmitters/receivers n ~ 1, 
the averaging and maximization over Q in Eq. ( p"2| ) can 
be carried out by a numerical simulation (see, e.g., Ref. 
|(] for n = 2 and Ref. |l] for n = 2 and 3). At large n 
such an approach becomes inadequate. It appears, how- 
ever, that analytic methods can be applied to estimate 
the asymptotic behavior of capacity for n ^> 1 (see Ap- 
pendix [A] and Refs. [l6|, [lj| ^7]). In the limit of large n 



the capacity per receiver is given by 

M = if^logUs/N)- 1 / 2 + Ki q iU 
n n * — ' L 

i=l 

1 n r 
+ -Vlog (S/N)~ 1/3 + W 
»=l 

- uv/\n2 + log{S/N), 



(13) 



where the eigenvalues of the matrix K, while the 

auxiliary variables u, v, and p < n nonzero eigenvalues 
qi of the matrix Q are solutions of the following system 
of equations (see Appendix ^ for derivations): 



1 n 

1 x ^ Ki 

(S/N)- 1 / 2 + Kiv' 

i—l 
1 n 

1 \ - KiQi 

n hi {S/N)- 1 / 2 + K iqi u 

KiU 

(S/N)' 1 / 2 + k^u' % = 
p 



i. 



(14) 

(15) 
(16) 

(17) 



In principle, the above equations are sufficient for the cal- 
culation of the average capacity at given n> 1, S/N, and 
ka. It should be noted, however, that the total number of 
equations is p + 3 (with p that can be as large as n) , and 
that the equations are nonlinear. Hence, the numerical 
solution requires considerable computational resources at 
large n. Besides, the interpretation of numerical results 
is known to be a rather difficult task. Below we show that 
in the limit of n — > oo, Eqs. (|l3])-(|l7|) can be significantly 
simplified and even that simple analytic expressions for 
(C) can be obtained in certain cases. 



C. Average capacity at n — > oo 

As we already mentioned in Sec. [ij], the covariance ma- 
trix K is Toeplitz and hence for n — > oo one can use the 
limit theorems known for this class of matrices ]2(| . Of 
particular use for us is the fundamental eigenvalue distri- 
bution theorem of Szego that states that if K is a n x n 
Hermitian Toeplitz matrix and F(x) is some continuous 
function then (under certain conditions fulfilled in our 
case) 



1 1 1 /■27T 

lim =o- / *"[/(/*)] dji 

n— too n ^— ' 2ir Jo 



(18) 



where f(fJ-) is the power spectral density defined in Eq. 
. We now admit that the right-hand sides of Eqs. 
|)-(p^[) can be readily simplified using Eq. jl^). After 
some algebra this leads to the following set of equations 
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for the auxiliary variables u and v: 



i r 2 * 



-1/2 



•«/(/*) 



d/i, (19) 



1 1 

It 27T 



2n 



-4 



f(n)>v/y/S/N 



d/i, 



(20) 



while the expression (|l^) for the average capacity per 
receiver becomes 



n 




where the integral in Eq. (J2(J) and the first integral in Eq. 
( pl| ) are over the part of the interval (0, 2tt) where /(//) > 
{S/N^^v, while the last integral in Eq. (|l|) is over 
the part of the same interval where /(//) < {S/N)~ 1 / 2 v. 
Once /(/i) is known, Eqs. (||)-@ allow one to calculate 
the average capacity per receiver, (C) /n, in the limit 



1. Average capacity at n — > oo and k£ ^ oo 

We first consider the limit — > oo. Although par- 
ticularly simple results can be obtained in this case, we 
will show later that this limit can serve as a good ap- 
proximation to real situations with large but finite kl. If 
< ka < 7T, we find (see Appendix |B|) 



where 
ka 



(C) ka , 

= — log 

n it 



ka 



s_*_l_ 

N ka<j) 



E5- < 22 > 



2(S/JV) V 



(23) 



Analytic results for (C) /n can also be obtained at ka > 
7r, but the resulting expressions are rather cumbersome 
and lengthy and we present them in Appendix [b|. In Fig. 
H we show the average capacity per receiver (C) /n, as a 
function of normalized receiver spacing fca/-7r at a fixed 
signal to noise ratio S/N = 100. The solid line shows our 
analytic result, corresponding to the limit n — > oo [Eq. 
( p2| ) at < /ca < 7r and more lengthy but analytic for- 
mulas given in Appendix M at ka > tt] , while the dashed 
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FIG. 4: Average information capacity per receiver of a com- 
munication channel between two identical linear arrays of n 
equally-spaced transmitters/receivers as a function of normal- 
ized receiver spacing for k£ — > oo and n — ► oo (solid line), 
n = 100 (dashed line), and n = 10 (dotted line). The signal 
to noise ratio is S/N = 100. The inset is a zoom of the main 
plot. 



and dotted lines are obtained by a numerical solution of 
Eqs. @-(|l7|) at finite number of receivers n (n = 100 
and 10, respectively). As follows from our analysis, at 
kt — > oo and n —> oo, the derivative of (C) with respect 
to ka exhibits a discontinuity at ka — rrm (m = 1,2,...). 
Although the discontinuity disappears at finite n, the 
overall agreement between the results corresponding to 
finite n and n — > oo remains satisfactory even for n as 
small as n — 10. The analytic results corresponding to 
the limit of n — > oo can therefore serve as a reasonable 
approximation in real situations with large but finite n. 



2. Average capacity at n — > oo and finite k£ 

Although kl is large in the experiments performed in 
the diffusion regime j7], |8|, ^2|, , its value remains finite 
and it is therefore of interest to consider its effect on the 
average capacity. At finite kl the power spectral den- 
sity f(jj) is given by Eq. (g) and Eqs. @-@ can be 
solved only numerically. The solution is, however, quite 
simplified by the fact that the result corresponding to 
kl — > oo is known analytically (see Appendix |B|) and can 
be used as a good starting point for the numerical algo- 
rithm. The average capacity per receiver obtained from 
Eqs. at kl = 100 and 10 is shown in Fig. | 

by dashed and dotted lines, respectively. The solid line 
shows the kl — > oo result, the same as in Fig. ^. As fol- 
lows from Fig. ||, at finite kl the capacity is somewhat 
higher than at kl — > oo . This is explained by a lower de- 
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ka/rr 



FIG. 5: Average information capacity per receiver of a com- 
munication channel between two identical linear arrays of n 
equally-spaced transmitters/receivers as a function of normal- 
ized receiver spacing for n — > oo and kl — > oo (solid line), 
kl = 100 (dashed line), and kl = 10 (dotted line). The signal 
to noise ratio is S/N — 100. The inset is a zoom of the main 
plot. 
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FIG. 6: Average capacity of a communication channel be- 
tween two identical linear arrays of n transmitters/receivers, 
normalized to its value at ka — mm, is shown as a function of 
the normalized receiver spacing for five different values of the 
signal to noise ratio S/N . We assume kl — > 00 and n — > 00 
for this plot. 



gree of correlation between the entries of the Green ma- 
trix G for smaller kl [see Eq. (Q)]. Also, the derivative 
of (C) with respect to ka exhibits no jumps at ka = mix 
(m = 1,2,...) when kl is finite. In general, however, the 
average capacity is only slightly affected by the finiteness 
of kl as long as kl remains much larger than unity. 



D. Maximum capacity and optimal receiver spacing 

It follows from Figs. ^ and || that as long as n 1 and 
kl 3> 1, the average capacity per receiver is very close to 
its value for n — ► 00 and kl — > 00. We therefore limit 
the rest of this subsection to the discussion of the lat- 
ter limiting case, assuming that the behavior of (C) jn 
remains similar at finite but large n and kl. The typi- 
cal behavior of the average capacity per receiver shown 
111 Figs. I and I can be summarized as follows: (C) /n 
has its absolute minimum at ka — > while it reaches its 
maxima at ka — rrvn (m = 1,2,...) and becomes almost 
independent of ka for ka > it. It appears, however, that 
such a behavior is typical only for large signal to noise ra- 
tios S/N > (S/N) c , where (S/N) c is some critical value 
of S/N that we define below. To study the capacity as 
a function of ka at various values of S/N, we plot the 
capacity normalized to its value at ka = mn in Fig. |(| 

As follows from Fig. § at large S/N {S/N = 10 and 
S/N — > 00) the behavior of capacity with ka is similar 
to that shown in Figs. || and ||. Interestingly, in the 
limit S/N — > 00 we find a very simple result: (C) /n = 



(ka/ir) log(S/N) at ka < ir and (C) /n = \og(S/N) at 
ka > 7r, i.e. the capacity grows linearly with ka for ka < 
7r and then remains constant for ka > ir. At finite but 
large S/N the behavior of capacity is less simple but is 
qualitatively very similar: (C) /n first shows a monotonic 
increase with ka for ka < n and then oscillates weakly 
with ka for ka > ir (see also Figs. [| and ||). As we 
noted above, such a behavior is typical only for S/N > 
(S/N) c . At smaller values of the signal to noise ratio, 
(C) /n exhibits a non-monotonic behavior with ka for 
ka < ir. More precisely, it reaches a maximum at some 
ka < it, as can be seen from Fig. ^ for S/N = 0.05, 0.1, 
and 1. We call the value of ka maximizing the average 
information capacity optimal and denote it by (fca) opt . 
In addition, we define the maximum capacity (C) max as 
the capacity maximized over ka: 



max max ( log det 

ka Q 



In + ^Q + QQ 



(24) 



It follows from Eq. (22) that (fca) pt and (C) max depend 
on the signal to noise ratio S/N in a very simple way: 



(fca)opt 
(C) 

max 



n 



Axy/S/N, S/N<(S/N) C , f2 ,, 
S/N>(S/N) C , [Z0) 

A 2 ^S/N, S/N < (S/N) c , 

log [(S/A0/>max] " ^max/ In 2, (26) 

S/N > (S/N) c , 



where (S/N) c 



3.35, Ax ~ 1.72 and A 2 



0.92 are 
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FIG. 7: Normalized optimal receiver spacing, maximizing the 
information capacity, as a function of the signal to noise ra- 
tio. The inset shows the maximum average information ca- 
pacity per receiver (C') max /n. The dashed line is (C) jn 
at ka — rmv (m = 1,2,...), coinciding with (C*) max /n 
for S/N > (S/N) c ~ 3.35 but smaller than the latter for 
S/N < (S/N) c . The vertical dotted line is S/N = (S/N) c . 



numerical constants, and 



2S/N 



(27) 



The normalized optimal receiver spacing (fca) opt is 
shown in Fig. ^, while the maximum capacity (C) max 
is shown, in the inset. For comparison, we also show the 
capacity corresponding to ka — ran (the dashed line in 
the inset of Fig. ^) which coincides with the maximum 
capacity for S/N > (S/N) c but is smaller than the lat- 
ter if S/N < (S/N) c . It is interesting to note that at 
ka = mm the average capacity scales linearly with S/N 
for S/N — > 0, while the average capacity maximized over 
ka is proportional to the square root of S/N in the same 
limit. Hence, the latter can exceed the former signifi- 
cantly for small signal to noise ratios. 

Qualitatively different behavior of the average capac- 
ity at small and large signal to noise ratios, illustrated 
in Figs. U and [j], can be understood without any lengthy 
calculations. We first remind that at ka < ir, accord- 
ing to Eq. (Q), smaller ka means stronger correlation 
between the Green functions G a i. Next, we map the 
quite complicated communication channel shown in Fig. 
|l| onto an equivalent set of n ' independent communica- 
tion channels, the capacity of each equivalent channel 
being ~ log(l + S'/N'), where S' and N' denote the 
signal and noise powers in each of n' independent chan- 
nels. Obviously, the number n' of equivalent independent 
channels grows with decreasing the correlations between 
the entries of the Green matrix G. Consequently, since 



the total capacity is n' \og(l + S' /N'), it seems that hav- 
ing zero correlations (and hence ka = ran) should always 
maximize the capacity because it ensures the largest n' . 
This reasoning, however, is not correct, since the signal 
power S ' is also sensitive to the correlations between the 
entries of the Green matrix G. Indeed, partially corre- 
lated Green functions G a i lead to a constructive interfer- 
ence of scattered waves at the receivers, thus increasing 
the power of the received signal, while the noise power 
N' remains unchanged. Therefore, when changing the 
receiver spacing ka from to 7r, one gradually switches 
from a small number of equivalent independent channels 
n' with relatively large signal to noise ratio S'/N' to 
a larger number of equivalent independent channels n' 
with weaker S'/N'. If S'/N' is large (which is only pos- 
sible if S/N is large), the capacity of each independent 
channel log ( 1 + 5 ' JN ' ) « log{S'/N') depends on S'/N' 
only logarithmically, while the dependence of the total 
capacity on n' is linear. To achieve the maximum capac- 
ity one therefore needs to choose the largest n' = rt/ nax 
(which corresponds to ka — mir), the decrease of capac- 
ity of each equivalent channel being negligible due to its 
weak (logarithmic) dependence on the signal to noise ra- 
tio. In contrast, if S'/N' is small (which corresponds 
to small S/N), the capacity of each equivalent channel 
log(l + S'/N') w S'/N' depends linearly on the sig- 
nal to noise ratio. In this case, the maximum capacity 
is achieved by choosing some optimal number of inde- 
pendent equivalent channels n ' < n^ax (and hence some 
optimal value of ka < 7r), which is large enough, but less 
than n4 ax to ensure a reasonable value of S'/N' in each 
of n' equivalent channels. This explains the origin of the 
optimal receiver spacing and its behavior shown in Fig. 



f 



IV. CONCLUSION 



In the present paper we study the information content 
of coherent multiple-scattered wave fields in disordered 
media and the capacity of multiple-scattered waves to 
transfer the information through a disordered medium. 
We show that the information-theoretic quantities, such 
as the differential entropy h of the multiple-scattered 
wave field and the information capacity C of a commu- 
nication channel in a disordered medium, are directly 
related to the mesoscopic correlations between the scat- 
tered waves. Mesoscopic correlations reduce the infor- 
mation content of the coherent, multiple-scattered wave 
field in a disordered medium, leading to a smaller num- 
ber of bits required to store all the relevant informa- 
tion about it. To consider the transfer of information 
by multiple-scattered waves, we limit ourselves to the 
case of communication between two identical linear ar- 
rays of n equally-spaced transmitters/receivers (receiver 
spacing a). The average information capacity (C) of such 
a communication channel is shown to scale linearly with 
n, analytic expressions for (C) /n are obtained in the 
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limit n — > oo and kl — > oo. For finite but large values 
of n and kt the capacity per receiver (C) /n is somewhat 
greater than at n — > oo, k£ — > oo, but the latter lim- 
iting case proves to be a fairly good approximation as 
long as n ^> 1 and W ^> 1. Our analysis shows that if 
the signal to noise ratio S/N exceeds the critical value 
(S/N) c ~ 3.35, (C) jn grows monotonically with a as 
long as ka < it and then oscillates slightly below its 
maximum value achieved at ka = ran (m = 1, 2, . . .). If 
S/N < (S/N) c , the behavior of the average capacity per 
receiver (C) /n is not monotonic for < ka < tt and an 
absolute maximum of (C) jn is reached at some ka < w. 
We define the maximum average capacity (C) max as the 
average capacity maximized over the receiver spacing 
a and the normalized optimal receiver spacing (fca) op t 
as the spacing maximizing the average capacity. Both 
(C) max /n and (ka) opt are proportional to (S/N) 1 / 2 for 
S/N < (S/N) c . At S/N > (S/N) c , we find (ka) opt = mir 
and(<7> max /rcoclog(S/iV). 
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APPENDIX A: AVERAGE CAPACITY AT n»l 

In this Appendix we follow Refs. [r] and |r] to cal- 
culate the average capacity (C) in the large-n limit. 
The idea of the calculation stems from the fact that 
the moment generating function of the random vari- 
able C = lndet[I„ + (S/N)g+QG}, F( 7 ) = (cxp(- 7 C)), 
writes Ffr) — exp(— 7 (C)) in the limit of 7 — > + . We 
start therefore by a calculation of F("/), keeping in mind 
that taking the limit 7 — > + will allow us to obtain 
the average capacity (C) = (C) /In 2. We admit that 

F( 7 ) = ([det(I n + (S/N)g+Qg)]^y and that for inte- 
ger 7 we can represent [det(J„ + (S/N)Q + QQ)] 7 as 

[det(J„ + {S/N)g+Qg)y~< = {S/N) n ^ J d/i(X, Y) 

\{s/Ny^ jr (X+X m + Y+Y m ) 



x exp 



if](Y+c?'X m -X+(?'+Y„ 



(Al) 



where Q' = Q 1 ' 2 g and we introduce 27 auxiliary complex 
vectors X TO and Y m (m = 1, ...,7) — the procedure 
known as the "replica trick", — and d/i(X, Y) is the 
appropriate integration measure. We now average Eq. 
(Al) over disorder, interchanging the order of averaging 



and integration on the right-hand side of the equation: 
F( 1 ) = (S/N)^ f d M (X,Y) 



x exp 



\{S/N)-^ £ (X+X 

m— 1 

\- (Y+AY ; X+BX m ) 



m,l — 1 



(A2) 



where (Q^Qfej = (l/n)A Q0J B 2j . The last term in Eq. 

( |A2| ) precludes the direct integration over X and Y. We 
can, however, reduce it to a sum of quadratic terms by 
defining 7x7 complex matrices U and V and introducing 
integrations along appropriate contours in the complex 
plain: 

F( 7 ) = {S/N) n ~< f d/i(X ) Y)d M ([/)d M (^) 



x exp 



-S 



(A3) 



where 



S = (S/N)-V 2 Y1 (X+X m + Y+Y m ) 



rn — 1 



£ (Y+jIY^ + KuX+BX, 



.,1=1 



nUmlVlm) . 



(A4) 



We now perform the integrals over X and Y in Eq. ( [A3] ) 
and are left with 

F( 7 ) = (S/AO' 17 / dM(C/)d/i(V) 



x exp 



{- 



In dct 



{S/N)- 1 ' 2 + AU 



— In dct 



{S/N)- 1 ' 2 + BV +nTr(UV)}, (A5) 

where AU and BV are the outer products of matrices. 

Introducing the eigenvalues and rji of the matrices A 
and B, respectively, we can rewrite the exponent in Eq. 
~1) as 



^2 {indet 

8=1 



(S/N) 



-1/2 



In det 



(S/N) 



-1/2 



I -nTr(f/F). (A6) 



In the limit n — ► co the integrations in Eq. (A5) can 
be performed using the saddle point method. Assuming 
that the replica symmetry is not broken at the saddle 
point, we have U — ul y an d V — vl 7 with 7 7 the 7x7 
unit matrix. Equation (A6) then becomes 



n 

M ^{ln [(<?/jV)- 1 /2+& u 



i=l 

+ In [(S/N)- 1 ' 2 + mv I - finuv 



(A7) 
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At the saddle point the partial derivatives of Eq. (A7) 
with respect to u and v should be zero. This yields the 
following equations for u and v: 



1 ™ 

nf^(S/N)-V 2 +& 



(A8) 
(A9) 



Relaxing the cond itio n of integer 7, we take the limit 7 — > 
0+ and put Eq. (|a|) in the form F(j) ~ exp(-7(C» 
with 



n 

(C) = ^{ln[(5/iV)-i/2 + e 

} 



i=i 
hi 



[(s/Ny^ + ^v 

nuv + n hi(S/N). 



(A10) 



The variance of capacity can also be found in a similar 
way (see Ref. |l9| for details), but we do not consider it 
here. Changing variables back from 5' to 5 we see that 
A = Q 1 / 2 KQ 1 / 2 and B ~ K yielding & = n.q, and 
rji = Ki with Ki and qi the eigenvalues of the matrices 
K and Q, respectively. Eqs. (A8)-(A10) then reduce to 
Eqs. @-© of Sec. Q 

To maximize the average capacity (C) over the ensem- 
ble of covariance matrices Q, we consider an infinitesimal 
variation SQ of the maximizing matrix Q and require 
S (C) < 0. This leads to Tr($£Q) < 0, where 



1. < ka < n 

If < ka < 7r, the power spectral density takes a 
particularly simple form [see Eq. (§)]: /(/i) = 7r/(fca) for 
< n < ka or 2tt — ka < /1 < 2ir, while f(u) = for 
ka < /j, < 2ir — ka. Integrations in Eqs. ( |19| ) and ( |20| ) 
can now be easily performed, since /(/i) > (S/N)~^v 
at < /1 < ka or 2-7T — ka < /1 < 27r and /(/u) = < 
(S'/A)~ 1 / 2 i; at ka < fx < 2ir - ka. This yields 



S_ 

N 

ka 1 

7T M 



-1/2 



fca / 5 

1 v — 

7T \ N 



-1/2 



(Bl) 
(B2) 



We now solve these equations with respect to u, v and 
substitute the solution into Eq. (pl|), where, again, the 
integrations are readily performed. This gives 



(C) ka , 

= — log 

n 7r 



5 7T 1 

N kacb 



In 2' 



(B3) 



where 



/ca 1 / /ca 

V ~ 2(S/N) \~ 



N 



which are Eqs. 



(-) ~ 

\kaJ 

and d|) of Sec.|ni. 



(B4) 



$ = (g [In + [S/N)G + QQ] V 



(All) 



The allowed variations SQ of the covariance matrix 
should keep Q + SQ positive definite and should not 
change the total emitted power: TrSQ = 0. If all eigen- 
values of Q are positive, the same is true for Q + SQ (pro- 
vided that SQ is small), and Tr($<5<3) = is achieved by 
<f> = 4>I n , where is a scalar: Tr($<5Q) = (j)TrSQ = 0. 
This can be also shown to remain true if some eigenval- 
ues of Q are zero [^9|. It then follows from Eq. (All) 
that for p nonzero eigenvalues qi of the matrix Q one has 
Eq. @ of Sec. |n[ Finally, Eq. @ is simply the total 
emitted power constraint TrQ = n. 



APPENDIX B: 



AVERAGE CAPACITY ATn^oo 
AND U^oo 



In this Appendix we derive analytic expressions for the 
average information capacity in the limit of n —> 00 and 
kl — » 00. We consider separately the cases of < ka < 
7r, 7r < ka < 2n, and 2n < ka < 3ir. At ka > 3ir 
calculations can be performed in a similar way. 



2. 7r < ka < 2n 

In this case, /(/x) = n/(ka) for < fx < 2tt — ka or 
ka < [i < 2tt and f(p) = 2n/ (ka) for 2n — ka < fi < ka. 
We now should distinguish two cases: (a) S/N > (S/N)i 
and (b) S/N < (S/N)i, where 







fka\ 









j y/(ka/n)[26-7(ka/n)] - 15 
3 — kajix 



\ 



- 1 



(B5) 



In the case (a\ f(fi) > (S/N)- l / 2 v for all /z G (0,2tt) 
and Eqs. jl9|), ( |20| ) become 



2 — ka/n 



v + (S/N)-V 2 ka/TT 

ka/n — 1 
v + (S/N)- 1 / 2 ka/(2Tr)' 



ka f S 
2^ \N 



-1/2 



v 3 



(B6) 
(B7) 
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The values of u and v found from the two above equations 
are to be substituted into Eq. (Ell) that reduces to 



f(n) > (S/N)' 1 ^ for all fj, G (0, 2tt) and Eqs. ©-(Hi 
reduce to 



M 

n 





fca^ 


log. 




(- 










ka 


/ fea 




log< 


r 2tt 








V w 






^ fea 



1 



u(S/iV)V2 
1 

viS/N) 1 /* 



7T 

fea 
2tt 
fea 



fo2 +1 ° g iV- 



(B8) 



In the case (b), /(/x) > (S/N)- 1 /^ only for 2tt- ka < 
fi < ka. Eq. ( p36|) remains the same, while Eqs. (B7) and 
(B8) become 



1 (ka 

U \ IT 



-1/2 



-1/2 



fea 
> — 
2tt 

iV 



ka 

7T 
UV 

ln2 " 



1 ] log 

5 



2tt 

A; a 



u(5/JV)V2 



-1/2 



2tt 
fea 



log 



(B9) 



fea 



(BIO) 



n 



3(fea/7r- 2) 



3i> + (S/N^^ka/ir 

3 — fea/7r 
v+{S/N)- 1 / 2 ka/(2irY 



ka f S 
6^ l^V 



-1/2 





/ fea 




log< 


f 3tt ' 




V 7T 


-2) 


fea 






fea A 


log< 


'2vr ' 


+ 


(- 




fea 



fea 
n 



v(SfN) 1 / 2 
1 

viS/N) 1 /* 



UV 

iri2 



log 



5 
iV' 



(B12) 
(B13) 



3tt 
fea 
2tt 
fea 



(B14) 



If S/N < (S/N) 2 [case (b)], f(p) > {S/N)- l ' 2 v for 
< (i < ka — 2n or 4tt — ka < fi < 2tt only and we have 
instead of Eqs. (fTl and flBll) 



3. 27r < fea < 37T 

We proceed as in the two previous subsections, /(/i) = 
37r/(fca) for < /i < fea — 27r or 47r — fea < /! < 2n, 
while /(a) = 2n/(ka) for fea — 27r < fx < An — ka. If 
S/N > {S/N) 2 [case (a)], where 



(fca/7r) 2 [fca/(27r) - 1] 



y/(ka/Tr)(32 - 5fca/7r) - 35 + 5 - ka/ir 



. (BH) 



n 



2 ka ka ( S 

u 2tt~ ~ 3tt V^V 

fea o V f 37r 



-1/2 



fea 
2^ 



1 



v(SfN) 1 / 2 



3tt 
fea 



3- — )log^(5/JV) 



TO , S 

h log — . 

La 2 B N 



-1/2 



(S/N) 



-1/2 , ™ 



, (B15) 



2tt 



ka 
(B16) 
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